GIT CONSTRUCTIONS OF LOG CANONICAL MODELS OF Mg 

jarod alper and donghoon hyeon 

1. Introduction 

The purpose of this article is to give an overview of the construction of compact moduh 
spaces of curves from the viewpoint of the log minimal model program for Mg (now coined as 
the "Hassett-Keel" program). We will provide an update on new developments and discuss 
further problems. We have attempted to complement recent articles by Fedorchuk and Smyth 
|FS10j and Morrison |Mor09j . and as a result our focus is put on the GIT construction of 
moduli spaces using low degree Hilbert points of curves. This method is expected to produce 
new compact moduli spaces of curves with increasingly worse singularities, and recent work 
by Ian Morrison and Dave Swinarski [MSll] is one solid step forward in this direction. The 
low-degree Hilbert quotients conjecturally realize various log canonical models of Mg 

Mg(a] = Proj em>o r(Mg,m(K;^g + otb)] 

as moduli spaces, for certain values of cx G [0, 1]. In the excellent survey [FSlOj . Fedorchuk 
and Smyth place the Hassett-Keel program in the larger context of birational geometry 
and classification of modular compactifications. On one hand, the Hassett-Keel program 
has stirred much excitement in studying and constructing various new compactifications; 
in fact, the ambitious paper |Smy09| provided a complete classification of stable modular 
compactifications. On the other hand, the log canonical models of M3 essentially account 
for all known compactifications for M3, and gives a complete Mori decomposition of the 
restricted effective cone; see |HL10b| . These entwined views are nicely discussed in |FS10| . 
The GIT construction of moduli spaces of curves with applications toward the Hassett-Keel 
program is carefully reviewed in Morrison's survey [Mor09j which we will be referencing 
frequently. 

Here we will be mainly interested in the sort of moduli problems that are "mildly non- 
separated" i.e. the ones involving moduli functors that are not separated but admit a 
projective moduli space nonetheless. In the language of [ASvdWlO] . these moduli problems 
are referred to as weakly separated; there may be many ways to fill in a family of curves 
over a punctured disc but there is a unique limit which is closed in the moduli stack. GIT 
quotient stacks of the form [X^^/G] are the model examples. Moduli spaces of sheaves or 
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more generally decorated sheaves as GIT quotients generally have strictly semistable points 
(and are therefore non-separated) but are weakly separated. The study of moduli of curves 
has revolved around the beautiful compactification Mg of Deligne-Mumford stable curves 
and weakly separated functors have become prominent only recently coinciding with their 
appearance in the Hassett-Keel program for Mg |HL07l IHM091 IHH08] . Likewise, although 
GIT has been around for decades, the construction of compact moduli spaces of curves in 
which non-isomorphic curves are identified has become a topic of pronounced interest only 
recently}^ We will elaborate on how GIT can be carried out in such problems. Once we have 
chosen a suitable parameter space, the construction proceeds roughly as follows: 

(1) Establish the GIT stability of nonsingular curves; 

(2) Destabilize undesirable curves such as: Degenerate and non-reduced curves, badly 
singular curves and special subcurves such as tails and chains; 

(3) Enumerate all potentially semistable curves with infinite automorphisms, and com- 
pute their basin of attraction and possible semistable replacements; 

(4) To finalize the construction, prove that potentially semistable curves are semistable. 
The argument heavily depends on the semistable replacement theorem and the ex- 
isting moduli spaces such as Mg and Mg^ [Sch91j . Basically, given a potentially 
semistable curve C, the proof entails arguing that all semistable replacements of the 
Deligne-Mumford (or pseudo-stable) stabilization of C is in a basin of attraction of a 
curve Co that is strictly semistable with respect to a one-parameter subgroup coming 
from Aut(Co). 

This strategy is taken in the constructions in |HL07j . |HM09j and |HH08j . Establishing 
the stability of smooth curves is definitely the most difficult step, and it was accomplished 
in |Mum77l IGie82j for curves and in |Swi08j for weighted pointed curves. The instability 
analysis of degenerate curves, non-reduced curves and badly singular curves has become 
rather standard following the work of Mumford and Gieseker. Although the configuration 
of destabilizing special subcurves in |HH08| are more intricate and their instability analysis 
is accordingly more involved, destabilizing tails and bridges appear in the work of Gieseker, 
Mumford and Schubert |Gie821 IMum771 ISchQlj : stable curves do not admit rational tail and 
rational bridges, and furthermore pseudo-stable curves do not admit elliptic tails; they are 
replaced by an ordinary cusp. But as we will see, these standard steps fail when applied to 
low-degree Hilbert stability, and addressing these issues will be a major focus of this article. 
The third step above is actually a new feature of |HL07| IHM09t IHH08| since Mg and Mg^ 
have only curves with finite automorphisms. In the moduli spaces of curves M" and Mg^ 
where curves with at worst nodes, cusps and tacnodes are parameterized, there are certain 



^It is worth mentioning here that Compact moduli spaces of pairs (C,E) consisting of a vector bundle E 
over a curve C generally have strictly semistable points |GM84I |Cap94| IPan96| 
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maximally degenerate curves (with infinite automorphisms) corresponding to minimal orbits 
in the Hilbert or Chow space; all other curves admits a unique isotrivial specialization to a 
maximally degenerate curve. This is a very useful structural property that is central in the 
construction of a projective moduli space of weakly separated moduli functors. 

Much of the material in this article has been drawn from other papers including the two 
nice surveys |FS10| IMorOQj . 

• In Section [2j we explain how a parameter space can be chosen for the GIT setup 
where the aim is to construct a log canonical model Mg ( a) of curves with prescribed 
singularities. We follow expositions in |Hyell| and |FS10t Section 2.4]. 

• In Section [3| we will briefly review Kempf's theory [Kem78| and the Grobner tech- 
niques developed in |MSllj . Using them, we provide two arguments to show that a 
tri-canonical genus two rational curve with two ordinary cusps a has semistable 2nd 
Hilbert point. This curve played a central role in the stability analysis of tri-canonical 
genus two curves |HL07j . These computations are new. 

• In Section [4| by using Grobner basis technique |BM88llHHL10j . we give a short proof 
of instability of mth Hilbert points of reduced degenerate curves, for any degree ra. 
In the non-reduced case, the same proof also gives instability for sufficiently large m 
as well as an effective lower bound for m. Non-reduced curves are in fact expected 
to appear in log canonical models arising from the GIT of low degree Hilbert points. 

• Although |Gie82j and |Mum77j provide fundamental ideas on picking destabilizing 
one-parameter subgroups, the dimension estimation method in |Gie82j is ill suited 
for computing Hilbert-Mumford index of low degree Hilbert points since we do not 
have the vanishing of higher cohomology. Instead, we let the undesirable curve 
specialize to a degenerate configuration and carry out the exact Hilbert-Mumford 
index computation there. This tells us precisely at which m the mth Hilbert point 
is semistable. In Section [5} we first explain how to figure out which curves specialize 



to a given maximally degenerate configuration curve with Gm, action (Section 5.1). 
We then apply these ideas to provide two methods to give precise predictions for 
which m an A2k+i -singularity would be m-Hilbert (semi)stable. 
In Sectionjoj we provide an etale local description of the flip Mg(9/1 1 ) — > Mg(7/10) <— 
Mg(7/10 - e) introduced in |HH08j based on the ideas of [ASvdWlO] . Moreover, we 
show that Mg(7/10 — e) are not Q-factorial. However, by scaling a generic boundary 
divisor rather than the "democratic" boundary, one expects Q-factorial flips. For a 
generic scaling, we provide a conjectural description of the critical values and the 
corresponding base loci. 



We work over an algebraically closed field k of characteristic zero. 
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2. Parameter spaces 

Hilbert schemes and Chow varieties are natural candidates for parameter spaces in the 
construction of moduli spaces of curves. While Chow varieties come with a canonical lin- 
earization, Hilbert schemes admit a family of linearizations, and one should choose the 
linearization depending on the desired properties of the space that one wishes to construct. 
From the point of view of the Hassett-Keel program, we would like to construct a moduli 
space on which 13A — (2 — cx)5 is ample, for a given a £ [0, 1] n Q. 

Given a nonsingular curve C of genus g > 2, V := H'^(cu^"'] is a k-vector space of dimension 
N + 1 = (2n — 1 )(g — 1 ) if u > 2 or g if n = 1 . The induced embedding C ^ P(V) defines 
the Chow point Chow(C) and the Hilbert point [C]. Taking the closure of the locus of such 
points (corresponding to nonsingular curves) in the Chow variety and the Hilbert scheme, 
we obtain our parameter spaces Chowg^n and Hilbg^ru respectively. 

Recall that Hilbg^n admits a family of embeddings 

/P(m) \ 

..:H.„„.c.P,.,,s^v.,.r(As^v.j 

when m is sufficiently large (> Gotzmann number |Got78j ). 

Definition 1. The image [Cjm of [C] S Hilbg^n under (|)rri is called the mth Hilbert point of 
C, and C is said to be m-Hilbert stable (resp., semistable, unstable) if [C]ra is stable (resp., 
semistable, unstable) with respect to the natural SL(V) action linearized by the embedding 
(jJiTi- C is Hilbert stable (resp., semistable, unstable), or asymptotically Hilbert stable (resp., 
semistable, unstable) if it is m-Hilbert stable (resp., semistable, unstable) for m » 0. 

If we are concerned with the m-Hilbert stability for fixed m smaller than the Gotzmann 
number so that (j)ra is not defined on the whole of Hilbg^m the GIT problem will be referred 
to as finite Hilbert stability problem. 

According to Mumford's Grothendieck-Riemann-Roch computation |Mum77[ Theorems 5.10, 
5.15], the canonical polarization on Chowg^n is positive rationally proportional to 

(4g + 2)A-f5, n = 1 
(6rL — 2)A — j8, otherwise 
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(1) 



where A is the determinant of the Hodge bundle and 6 is the divisor of the singular curves. 
Mumford's formula, combined with a basic Chern class computation, also shows that Ani,n := 
(^*^{0{+^)) on Hilbg, n is a positive rational multiple of 

jA + (m-l)[((4g + 2)m-g + l)A-SJ^8], n = 1 
1 (6mn2-2mn-2n+ 1)A- ^5, n>l 

|HH08|, P28. Equation (5.3)]. From this, we see that ATa,n is an SL(V)-linearized Q-Cartier 
divisor. This allows us to define m-Hilbert (semi) stability for rational m: 

Definition 2. Given a positive rational number ra, we say that [C] G Hilbg^n is ra-Hilbert 
(semi,un)stable if it is GIT (semi,un)stable with respect to fAra,n for sufficiently large £ G Z. 

Equation (1] suggests that the log canonical model Mg(a] may be obtained from the GIT 
of Hilbg^n with a suitable linearization Am_^rL- More precisely, suppose we know that: 

• Hilbg^|[^ ^ 0, where Hilbg^^ denotes the semistable locus with respect to the lin- 
earization Ara^n- 

• The locus in Hilbg^|[^ of curves which are not Deligne-Mumford stable has codimen- 
sion at least 2. 

Then the map Mg Hilbg^n /SL(V) is a birational contraction. The natural line bundle 
on Hilbg^n /SL(V) descended from Ara,n pulls back to a linear combination of A and 6 on 
Mg as specified in Equation (1) modulo exceptional divisors. It follows that Hilbg^n /SL(V) 
is identified with Mg(cx) where a = 2 — 13/s and s is the slope of the divisor in Equation (1 ) 
since the addition of positive multiples of exceptional divisors has no effect on the section 
ring. 

For instance, when n = 2, Ara,n is proportional to 13A — (2 — cx)5. For meaningful values 
of m and a, there is a one-to-one order preserving correspondence: 

f 1 3(2 -«) 14m -6 

2[7 — lOaJ 20m — 3 

By computing the m(a]-Hilbert semistable curves, we can predict which singular curves may 
appear in Mg(a). |FS10j also explains how one can predict the singularities that appear in 



Mg(a) as constructed by GIT, by using character theory. Table 6.2 (reproduced from |FS10] 



at the end of this article) nicely summarizes what has been shown and what we expect. The 
last four lines of the table are conjectural with a few partial results supporting them. In 
|HL10aj is given a construction of a birational map M4 — > M4(2/3] that contracts the locus 
of Weierstrass genus 2 tails, which is precisely the variety of stable limits of A4-singularities. 
This is consistent with the prediction that Weierstrass genus two tails would be replaced 
by A4-singularities in Mg(2/3). In |ASvdW10] . Alper, Smyth and van der Wyck takes a 
GIT-free approach in constructing the log canonical models. Their plan is to first define the 



6 



JAROD ALPER AND DONGHOON HYEON 



moduli functor with desired properties, show that it is deformation open and weakly proper, 
and prove that a projective coarse moduli space exists. They accomplish the first step of 
this ambitious program in [ASvdWTO] . 

3. Finite Hilbert Stability 
First, let us recall the classic result on stability of smooth curves. 

Theorem 1. jGie821 IMum77j A smooth curve of genus g embedded by a complete linear 
system of degree d > 2g + 1 is both Hilbert stable and Chow stable. 

The proof of this theorem is thoroughly reviewed in |Mor09] and we will not discuss it 



here. Instead, we will address the question of finite Hilbert stability; see Table 6.2 for the 
correlation between the integer m and the log canonical models Mg ( a) . We emphasize that 
finite Hilbert stability is completely different from the asymptotic case as we do not have 
the vanishing of higher cohomology and the weight space dimension estimation method is 
not feasible. We will explain how one can prove the finite Hilbert semistability of certain 
singular curves whose automorphism groups satisfy a multiplicity condition. Establishing 
the semistability of any smoothable curve of course implies the semistability of a generic 
smooth curve, and though it is certainly far short of the stability of all smooth curves, we 
allow ourselves to be content with it for now. To complete the stability proof, we would 
have to resort to a semistable replacement argument. 

Recall the setup: the parameter space is the closure in the Grassmannian of the image of 

HUb°^2 ^ Gr(P(m),S"'V*) 

where the superscript o denotes the locus of m-regular curves. Immediately we realize that 
even destabilizing unwanted objects is perhaps more subtle as the boundary points may not 
even correspond to curves. 

3.1. Semistability of the bicuspidal rational curve. In this section, we will sketch the 
technique from |MSllj and use it to show that a tri-canonical genus two rational curve Cq 
with two ordinary cusps is 2-Hilbert semistable. 

Remark 1. Definition 4.8 in |MS11| assumes that the automorphism group of the variety 
in question has a finite subgroup acting by linear automorphisms, but their method works 
without the finiteness assumption as we shall demonstrate below. 

Note that Cq is unique up to isomorphism. This particular curve played an important 
role in the construction of in |HL07j . It is the unique strictly semistable pseudo-stable 
curve of genus two with infinite automorphisms. Other strictly semistable curves specialize 
to it via the Gm. action coming from Aut(Co] (Figure [T]). The tri-canonical image of Cq may 
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Figure 1. Basin of attraction of a bicuspidal genus two curve 
be parametrized by 

[s,t] ^ [s^,sH\sh^,sh\t^] 

from which we compute its defining ideal: 

(X^ -XiX4,XiX3 -XoX4,x| -XoX4,xf -X0X3). 

For a G Gra, the automorphism [s, t] 1— > [as, t] of induces an automorphism (\)oc G GL(V) of 
Co, and we denote by F the subgroup of GL(V) consisting of ^aS. Note that V is (isomorphic 
to) the identity component of the automorphism group of Co- We have 

C StabGL(v]([Co] mJ 

and r acts on V with weights (6,4,3,2,0) inducing the weight space decomposition V = 
Vg e V4 e V3 e V2 © Vi such that a.v = (x^v, V(a,v) G Gra x V^^. The key point is that, 
since the weights are aU distinct (this corresponds to the multiphcity free condition [MSll^ 
Definition 4.5]), the decomposition above determines a unique maximal torus Tp C GL(V). 
Note that the coordinates we use above are compatible with Tp. 

Now, Kempf's theory jKem781 Theorem 3.4 and Corollary 3.5] says the following. 

(1) If [Co]m S Hilb2,3 were unstable, then there would be a worst one-parameter subgroup 
p* whose associated parabolic subgroup P compatible with the p*-weight filtration 
contains StabG]_(v)([Co]ra)- 
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(2) Also, if T' is a maximal torus contained in P, then there is a 1-PS p' of T' such that 

^([Co]m, P*) = M-([Co]m, p']- 

But r C StabgLfv) ([Co]m) C P, F preserves the flag of P and by the complete reducibility of 
r, each step of the flag is a direct sum of F-weight spaces. Hence Tp also preserves the flag 
of P i.e. Tr is a maximal torus of GL(V) contained in P, and Kempf's theory implies that 
there exists a 1-PS p of Tp such that |J.([Co]Ta) P*) = M-([Co]m) p)- 

In summary, if [Co]ra were unstable, then it is destabilized by a one-parameter subgroup 
p contained in our favored maximal torus Tp compatible with the F-weight space decompo- 
sition. In other words, we only need to check the stability with a fixed basis compatible 
with Tr, for instance (xq, . . . , X4) from before, and we will do just that by employing the sys- 
tematic state polytope trick developed in jBM88j (implemented by Dave Swinarski into the 
Macaulay 2 package statePolytope). In the code below, statePolytope(2,I) computes 
the 2nd state polytope of the ideal which has 10 vertices. The command isStable(2, I) 
confirms that the 2nd state polytope of I contains the barycenter (8/5, . . . , 8/5), so Co is 
2-Hilbert semistable. 

11 : loadPackage ( "StatePolytope" ) ; 

12 : R=QQ [a,b,c,d,e] ; 

13 : I = ideal(-b*e+d"2,-a*e+b*d,-a*e+c~2,-a*d+b~2) ; 

14 : StatePolytope (2, I) 

o4 = {{1, 3, 0, 3, ly, {1, 4, 0, 1, 2}, {2, 1, 0, 4, 1}, {2, 2, 0, 2, 2}, {1, 
1, 2, 4, 0>, {2, 0, 2, 3, 1}, i2, 1, 2, 1, 2}, {0, 3, 2, 3, 0}, {0, 4, 2, 
1, 1}, {1, 3, 2, 0, 2}} 

04 : List 

15 : isStable(2,I) 

05 = true 

In fact, the ideal is simple enough that the computation can be done easily by hand in the 
degree two case. Given a one-parameter subgroup Gra — > SL4 with weights (tq, ti , . . . , 74), 
we shall prove that there exists a monomial basis of H'^(C, Oc[2.)) whose weights have non- 
positive sum. One easily checks that the set Bi (resp., B2, B3) consisting of all monomials 
except for {xf,X2,X3,xoX4} (resp., {xiX4,xoX4,xoX3,xiX3}, {xiX4,xoX4,xoX3,X2}) is a monomial 
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basis of H (C, Oc[2]). If the sum of the weights of the basis Bi is positive, then tq + 2ri + 
2r2 + 2r3 + 74 < or ri + r2 + r3 < 0. If the sum of the weights of the basis B2 is positive, 
then 2to + 2ri +2r3 +2r4 < or r2 > 0. If the sum of the weights of the basis B3 is positive, 
then 2ro + ri +2r2 + r3 + 2r4 < or ri +r3 > 0. Obviously, all three inequalities cannot hold 
at once, and one of the bases Bi , B2 or B3 must have a non-positive sum of weights and we 
conclude that C is 2-IIilbert semistable. 

4. Unstable curves: Degenerate and non-reduced curves 

Mumford's numerical criterion can be used to destabilize an unwanted variety effectively. 
The following formulation of the Hilbert-Mumford index is given in |BM88j . It was heavily 
used in the work of Hassett, Hyeon, Lee and Morrison. A Macaulay 2 implementation is 
given in |HHL10) . 

Proposition 1. Let X C P(V) be a projective variety defined by a homogeneous ideal I. The 
Hilbert-Mumford index of [Xl-m with respect to a one-parameter subgroup p : Gm. — > GL(V) 
with weights Tq, ti , . . . , tn is given by 

(3) ^.([XUp) = ^^L-i-L-tp(x^"') 

where a(1), . . . , a(P(m)] index the monomials of degree m not contained in the initial ideal 
in^p(I). In particular, [X]ra G P(/\'''"^^ Sym^V) is stable (resp. semistable) under the 
natural GV[\)-action if and only if for any one-parameter subgroup p we have 

wtp(x"('') < ^^^^n [resp. <). 

j=i 

Here, -<p denotes any fixed graded total order that refines the graded p-weight order. 

Using this algorithm, we give the following short proof of the instability of degenerate 
varieties. It implies that a reduced degenerate variety is m-Hilbert unstable for all m 
whereas the results in the literature are of asymptotic nature. 

Lemma 1. IfXc P'^ is contained in the rth thickening of a hyperplane, then it is Hilbert 
unstable for m > (N -|- 1 )(r — 1 ). In particular, if X is a non-reduced degenerate variety, then 
X is m-Hilbert unstable for all ra. 

Proof. Let I be the homogeneous ideal of X. The hypothesis implies that we may choose 
coordinates so that Xq G I. Let p be the 1-PS with weights (0,1,..., 1). If divides a 
monomial x'^, then x" G I and hence x" G in^p(l). So any degree m monomial not in the 
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initial ideal has p- weight at least m — r + 1 . It follows that 



^([X]m, P) 



= -Lx-0m^p(I)^Wtp(x'^) + 



mP[m] 
N+1 




a||=m 



< -(m-r + 1)P(m) + mP(m) 
= P(m) (-^m + r-1) . 



N 
N+1 



Here, ti are the weights of p which sum up to N. It is evident that |a.([X]ra, p) < for 



Remark 2. The "standard" instability proof for non-reduced curves fails completely when 
applied to the finite Hilbert stability case, which it should, since non-reduced curves are 
expected to appear in Mg(5/9). This corresponds to the GIT quotient moduli space of 
bicanonical 3/2- Hilbert semistable curves. 

5. Unstable curves: Badly singular curves and special subcurves 

From the work of Mumford and Gieseker, we have fairly standard if not fully systematic 
procedures to produce one-parameter subgroups for destabilizing curves with undesirable 
singularities. But the proof in |Gie82| is ill suited for dealing with low degree Hilbert points 
since it is designed to work for general curves (with the singularity in question) and depends 
on the vanishing of higher cohomology. Instead, the proofs in |HL071 IHM09t IHH08] employ 
the following strategy. First we need to define the basin of attraction: 

Definition 3. Let X be a variety on which Gra acts via p : Gra — > Aut(X) with fixed points 
X^. For each x* G X^ , the basin of attraction is defined 



Suppose that we are carrying out GIT : a reductive group G acts on a (projective) variety 



|x(x*, p). In particular, x is unstable with respect to p if and only if x* is. Moreover, if x* 
is strictly semistable with respect to p, then x is semistable if and only if x* is; see |HH08t 
Lemma 4.3]. 

The GIT strategy pursued in |HL071 IHM09[ IHHOSj for destabilizing a curve C proceeds 
as follows: 

(1) Find a degenerate configuration Co of C with positive dimensional automorphism 
group. 

(2) Test the stability of Co against one-parameter subgroups p coming from Aut(Co). 

(3) Compute the basin of attraction of (the Hilbert/Chow point of) Co and show that 
it contains C. 



m> (N + 1)(r-l). 



□ 




X linearly and p : G 



G is a 1-PS fixing x*. If x G Ap(x*), then by definition |j.(x, p) 
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For the degenerate Co and p coming from Aut(Co), we can explicitly compute the Hilbert- 
Mumford index. Consider the fohowing facts: 

(1) The p-action is nontrivial only on the rational subcurve from which p comes. So we 
can compute the exact weight of the p-action by using the Grobner technique; 

(2) |J.([Co]m> P) is a quadratic polynomial for m larger than or equal to the regularity of 
Co. 

Hence by computing M.([Co]m)p] for m up to the regularity of Co plus a couple, we can 
explicitly compute the index and hence determine exactly for which m Co is stable, semistable 
or unstable with respect to p. 

5.1. Basin of attraction and deformation space with Gra-action. How does one com- 
pute the basin of attraction of the degenerate Co? Assuming that our parameter space X is 
smooth (in fact, one can show using deformation theory that the relevant Hilbert and Chow 
parameter spaces are smooth), we have the Bialynicki-Birula decomposition X = UX^ with 
the following properties: 

(1) The sets X? of points in X^ fixed under the p-action are precisely the connected 
components of the fixed point set X^. 

(2) There is an affine bundle morphism Qj. : Xt — > X? such that ©r^(x*) = Ap(x*), 
X* G Xf. 

(3) T,*X, = (T.*X)>o, x'^ G Xf. 

In the third item, the subscript > means the non-negative weight subspace of the Gra 
action via p. The decomposition suggests an effective method to compute the basin of 
attraction. Indeed, let X be the Hilbert scheme Hilbg^n and Co be a curve with positive 
dimensional automorphism group. Under certain stability conditions, for instance c- or h- 
semistability jHHOSl Definition 2.5, 2.6], Hilbg^n is smooth at x* := [Co] and we apply the 
Bialynicki-Birula decomposition theorem. To figure out which curves are in the basin of 
attraction Ap(x*), we analyze the Gra action on the tangent space T[Cq] Hilbg^n- Actually 
for our purpose, by Luna's etale slice theorem, we may work with a Gra-invariant locally 
closed etale slice W C Hilbg^n containing x*. But in this case, the space Def(Co) of first 
order deformations at is Gin-equivariantly isomorphic to W at x* etale locally, and the 
problem is now reduced to analyzing the Gra action on the deformation space. The analysis 
in |HM09l IHHOSj all follow this line of ideas and basin of attraction computation is done 
simply by checking which curves are in the non-negative weight subspace of the deformation 
space. In fact, we only looked at the local deformation spaces at the singular points, in view 
of the exact sequence 

O^LTi(Co]^Ti(Co)^ n V[dco^^)^0 

peSing{Co) 
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where denotes the vector space of first order deformations and LT^(Co) is the subspace 
of locally trivial deformations. As seen in jHHOSj . for curves with at worst nodes, cusps and 
tacnodes as singularities, Gra acts trivially on LT^ (Co) and the problem was reduced further 
to analyzing the G^u action on OpeSing(Co) """^(Oco.p)- This is no longer the case in higher 
order singularities because of crimping |ASvdW10l Section 6] . 

As an application, we analyze the m-Hilbert stability of maximally degenerate curves 
with A2b-singularities. We will employ two techniques — a direct GIT computation of the 
Hilbert-Mumford indices and an alternative approach by explicitly computing the induced 
characters of the automorphism group on natural line bundles. 

5.2. Computing the Hilbert-Mumford index of cuspidal tails. 



Proposition 1. Hyell| Let C = D Up R be a bicanonical genus g curve such that R zs a 
rational curve of genus b > 2 with an Ajb singularity = x^^^^ and meets D in a node p. 
Then there exists a one parameter subgroup p o/SL3g_3 coming from Aut(R) such that 

\i{[CUp) = ^(m-l)((4b^-8b + 2)m-3b2) 

Retain C and p, and consider the basin of attraction Ap([C]Ta)- obtain: 

(1) Let C = D Up' R' be a bicanonical curve where R' is a hyperelliptic curve of genus 
b > 2 meeting in a node p', andji' is a Weierstrass point of^'. Then there exists 
a 1-PS p such that 

^( [C']nx, p) = ^ (m - 1 ) ( (4b2 - 8b + 2)m - 3b2] . 

R' (and sometimes C itself by abusing terminology) is called a Weierstrass genus b 
tail. 

(2) Let C" be a bicanonical genus g curve obtained from C by replacing R by an Aib 
singularity. That is, C" is of genus g, has Ajb singularity at p" and admits a 
partial normalization v : (D,p) — ) (C",p")- Then there exists a 1-PS p such that 

^( [C"U P) = (m - 1 ) ( (4b^ - 8b + 2)m - Bb^) . 

This in particular implies that even though C is Deligne-Mumford stable (assuming D is 
so), it is m-Hilbert unstable for ra < 4^^^^^- For example, a genus two Weierstrass tail is 
m-Hilbert unstable for m < 5 and at best strictly semistable for m = 6. 

Proof. R is a rational curve of genus b with a single cusp q whose local analytic equation is 
= . C = D Up R is a bicanonical curve of genus g consisting of R and a genus g — b 
curve D meeting in a single node p. Restricting Oc(l] to R (resp. D), we find that it is of 
degree 4b — 2 (resp. 4g — 4b — 2) and contained in a linear subspace of dimension 3b — 1 
(resp. 3g — 3b — 1 ) . We can and shall choose coordinates such that R C {xsb-i = 'X-sh = • • • = 
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X3g_4 = 0} and D C {xq = xi = • • • = xsb-s = 0}. R may be parameterized by mapping [s,t] 
to 

[34b-2^ 34b^4^2^ 34b-6^4^ . . . ^ ^2b-2^2b^ ,2^^-5^2W ^ s2b-4^2b+2^ . . . ^ ^4b-2] 

SO that R has a single cusp x^^-, = x^^^^ at q = [1 , 0, . . . , 0], where we abused notation and 
let xi and Xb+i denote their images in the completion of the local ring at q. Let p denote 
the one-parameter subgroup with weights 

(0,2,4, 6,...,2b,2b + l,2b + 2,...,4b-2,4b-2,...,4b-2). 

The sum of these weights is r := ('^^2"^) - 'b^ + (4b - 2)(3g - 3b - 2). We shall fix the 
p-weighted GLex order on the monomials. 

Lemma 2. The sum WR^p(m) of the weights of the degree m monomials in Xo,...,X3b-2 
that are not in the initial ideal of R is 

WR,p(m) = (8b^ - 8b + 2]m^ + (2b - 1 ]m - b^. 

Proof. In general, weight computation of this sort can be accomplished by using Grobner 
basis, but in this case there is a more elementary solution since R admits a parameterization. 
Let PR(m) = (4m — 1 )(b — 1 ) + 2m, the Hilbcrt polynomial of R. A monomial of degree m 
pulls back to one of the following m(4b — 2) + 1 — b monomials 

3m(4b-2)-i^i^ i = 0, 2, 4, . . . , 2b, 2b + 1 , 2b + 2, . . . , m(4b - 2). 
If riiei,|i|=m'^i- riiej.ijhm P^^^ back to the same monomial, then 

n n 

iel,|l|=m ieJ,|J|=m 

is in the initial ideal inp(lR) of the ideal Ir of R with respect to the p-weighted GLex order. 
It follows that each s"i-(4b-2)-i-|.i appears at most once among the pullbacks of degree m 
monomials not in the initial ideal mp(lR). Since m(4b — 2) + 1 — b equals PR(m), it has to 
appear in the set exactly once. Therefore, 

WR,p(m) = Lto2k + LSE+> 

= (8b2-8b+2)m2 + (2b-l)m-b2. 

□ 

On the other hand, the contribution from D to the total weight is 

WD,p(m) = (4b-2)m-hO((Of |D)®"^(-p)) 

= (4b-2)m((4m-l)(g-b-1)+2m-1) 
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since p acts on D trivially with constant weight 4b — 2. Combining these weights and the 
average weight, we obtain the Hilbert-Mumford index of C: 

= lm(4m- l)(l(4b-1)(4b-2) -b^ + (4b - 2)(3g - 3b - 2)) 

-((8b2 - 8b + 2)m^ + (2b - 1 )m - b^) 

-((4b - 2)m((4m - 1 ) (g - b - 1 ) + 2m - 1 )] 
= I ((4b2 - 8b + 2)m2 + (-Zb^ + 8b - 2)m + Sb^) 
= I(m-1){{4b2-8b + 2)m-3b2) 

Next, we analyze the basin of attraction. The local versal deformation space of q is given 

by 

X2b+1 = ^f"^^ + C2b-ixf + C2b-2xf + • • • + Co. 

Since p acts on x-\ and X2b+i with weights 2 and 2b + 1 respectively, it acts on Ct with positive 
weight 4b+2— 2i, < i < 2b — 1 . Hence the basin of attraction contains arbitrary smoothing 
of the cusp q. By considering the local stable reduction |HasOO|, § 6.2.2], we can deduce that 
if D Up R is in the basin Ap([C]Ta), then R must be hyperelliptic and p is a Weierstrass point 
of R. Indeed, consider the isotrivial family C — > B = Speck,[[t]] whose general member is 
p(t).(D Up R) and the special member is C. Stable reduction of C yields C — > B', B' — > B 
a finite covering, whose general member is isomorphic to that of C and the special member 
is D Up/ R' where R' is hyperelliptic and p' is a Weierstrass point of R': This is precisely 
the content of [HasOOl § 6.2.2]. By the separateness of A^g, it follows that R is hyperelliptic 
and p is a Weierstrass point. On the other hand, p acts with weight —1 on the local versal 
deformation of the node p and the basin of attraction does not contain any smoothing of 
the node p. The assertion of the item (2) follows since p^^ acts with the opposite weight, 
and the basin of attraction contains arbitrary smoothing of the node p but no smoothing of 
the cusp q. 




Figure 2. Basin of attraction of cuspidal tail 
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This completes the proof of Proposition [T] □ 



5.3. An alternative approach using character theory. As in Section 5.2 let C = DUpR 
be a genus g curve where D is a smooth curve of genus g — b and R, a rational curve meeting 
D at a node p with a monomial A2b-singularity ^^ = x'^^^^ at q. One checks that there is an 
isomorphism r\ : Gra — > Aut°(C). Indeed, if we choose an isomorphism R ~ such that 
lies above the higher cusp and oo lies above the node, and let t be a uniformizer at zero, then 
these automorphisms act on R by t — > at (and act trivially on D), where a is the coordinate 
of Gra- As explained rigorously in [AFSlOj . the line bundles A, A2, 6 and K extend to a 
neighborhood of [C] in the the stack of all curves and induce characters XA(C,r|), XA2(C,ri), 
X5(C,ri) and XK(C,'r|). In this section, we will explicitly compute these characters and then 
recall how these characters gives an alternative computation of the Hilbert-Mumford indices 



computed in Section 5.2 (Of course, there are linear relations K = 13A — 25 and A2 = 13A — 5 
so that computing all four characters is redundant.) 

To compute the character XA(C,ri], consider a basis of H°(C, cuc) given by 



(^':^) ' (^':[^) (^'^) ,(uji,0),...,(cug_b,0], 

where tui , . . . , cug_b is a basis for cuq- Evidently Gra acts on this basis with weights 2b — 
1 ,2b — 3, . . . , 3, 1, 0, . . . , 0. Since Ai |[g = H'^(C, cuc), we deduce that 

b 

Xa(C,ii) =_^(2i-l) =b2. 
i=l 

Similarly, a basis for H'^(C, uOq) is given by 

/ (dt)2\ / (dt)2\ / (dt)2\ / (dt)2\ / (dt)2\ 

V ' "t4ir J ' (^0, J , ■ ■ . , (^0, j , (^0, ^ J , . . . , (^tuo, J , 

(0)1,0),..., (cU3g_3b_2,0) , 

where tui , . . . , cu3g_3b-2 is basis for H°(D, a)p(p)), and uoq is an appropriately chosen element 
of H°(D, tu^(2p))\H°(D, cu^(p)). It follows that 

b-l 2k-2 

XA2(C,Ti) =^(2b + 2i)+ ^i = 5b2-4b + l. 

i=0 i=0 

To compute the X6(C,il) and XK[C,r\), we write the first order deformation space as 



Ti(C)=Ti(D,p) xCrtOcq) xJitOcq) xTi(ac,p) 
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where Cr(Oc^q) denotes the "crimping" deformations (see jASvdWTO] for more details). We 
can choose coordinates 

(Oc,q) = {y' - x^^+^ + C2b-ix2^-i + • • • + ClX + Co = 0}, 
TVOc,p)={xy+n = 0}, 

where G-m acts via Ci i— > A^^^'^'^^^Ci and n i— > An. 

By |AFS10[ Proposition 5.7], the character X6(C,r|) is simply the additive inverse of 
the weighted degree of the discriminant. Since the discriminant of the Aib-singularity has 
weighted degree —4b (2b + 1 ) while node has weighted degree 1 , we have 

X6(C,Ti) =8b2 + 4b-1. 

By |AFS10| Lemma 4.15], the character XK(C,ri) is the character of (C). Using the above 
descriptions, we compute that the character of [C)c,q) is — (4 + 6 + • • • + (4b + 2)) = 
— (4b^ + 6b). The character of T^(Oc,p) is 1. The character of T^(Co,p) is trivial. For b > 2, 
by lASvdWlOl Proposition 3.4], the weights of the action on Cr[Oc a) are 1 , 3, . . . , 2b — 3. 
Therefore, the character of Cr(Oc,q) is (b — 1)^. It follows that 

Xk(C,ti) = -3b2-8b + 2. 

We have therefore established: 

Proposition 2. Let C = D Up R be the genus g curve with a nodally attached rational curve 
R with a monomial Ai^,- singularity. Letr\ : Gm — > Aut°(C) he the isomorphism given above. 
Then we have the following expressions for the characters: 

XA(C,ri) = b^ 
XA,(C,Ti) =5b2-4b + l 
X5(C,Ti) =8b2+4b-l 
Xk(C,ti) = -3b2-8b + 2 

It follows that the mth Hilbert-Mumford index is 

^([C]nx, p) = ^(m - 1 )((4b^ - 8b + 2)m - 3b^). 



Proof. The final statement follows from the usual computation of the divisor class of the 
GIT polarization (see [AFSlOt Proposition 7.1]). □ 
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6. Local study of the moduli spaces of c-semistable and of h-semistable 

CURVES 

In this section, we take a closer look at the flip |HH081 Theorem 2.12] 

fig 

We will (1) give an etale-local description of this flip and (2) show that Mg is not Q-factorial. 

6.1. Etale local presentation of the flip. An etale local study of the Hassett-Keel pro- 
gram is rigorously carried out in |ASvdWTOl Section 7] where it is shown that etale locally 
around any closed point [C] E -^"j the open inclusions of stacks 

Ml' c D 

correspond to the open chambers 

T^(C)- C T^C) D T\C)+ 

given by applying variation of GIT to the action of Aut(C) on the first order deformation 
space T^(C). We carry out this etale-local presentation in the particular case where C is a 
general closed curve with infinite automorphism. We then use this presentation to examine 
the flip in jHHOSj . 

Let C = D U Ri U R2 be a c-semistable curve of genus g consisting of 

(1) a smooth curve D of genus g — 2; 

(2) smooth rational curves meeting each other in a tacnode p and meeting D in a 
node qi, I = 1 , 2. 

The first order deformation space of C is 

T^ (C) =^ T^ (D, qi , q2) x T^ [Oc,^) x T^ (Ocq, ) x T^ (OcqJ 
and there are isomorphisms 

((5c,p] = [y^ =x^ + S2X^ + Six + So : Si G C} 
T^(Oc,qJ ={y^=x2 + ni : m G C}. 

If we fix an isomorphism Aut(C)° = Gra = SpecC[a]ix which acts on a local coordinate z 
around G by z 1— > ocz, then the action of Aut(C)° on T^ (C] is given by 

Si I— > a^^^^Si, TLi I— > Arii 
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and is trivial on (D,p). Now, in this simple case, the open chambers (C)^ and (C)^ 
are defined as the non- vanishing locus of functions of negative and positive weight respec- 
tively. That is, (C)^ C (C) 5 (C)+ are defined by the closed loci: 

Ti(C)\Ti(C)-=V(so,Si,S2) and (C) \ (C)+ = V(ni , ua). 

The fiip etale-locally at [C] corresponds to the flip arising from variation of GIT on the first 
order deformation space: 

T^Cl 





Def(C)//G^ 

The locus V(so,Si,S2) is the locus where p remains a tacnode and V(rLi,TL2) is the locus 
of curves containing an elliptic bridge. This is precisely the picture obtained in [HHOSj 
Figure 1] by carrying out the GIT. 




+ 




Figure 3. The first fiip 



■Hs . 



6.2. Q-factoriality of log-canonical models. We now show that Mg is not Q-factorial 
for g > 7. This may seem unexpected since Q-factoriality is preserved under a fiip in the 
log minimal model program as defined in |KM98t Definition 2.8]. However, the contraction 



-Mg(7/10 + e)^Mg(7/10)-,..g 

arising from the log minimal model program where the divisor 5 is scaled, contracts more 
than one extremal ray. Indeed, V contracts [^j^J (K -|- 7/105)-negative extremal rays in 
NE(Mg(7/10 + e]) corresponding to the ray To of separating elliptic bridges and the rays Tt 
for i = 2, . . . , [^^J of elliptic bridges which separate a curve into a genus i and g — i — 1 
components. However, if one scales a generic boundary divisor D = ^[^q^^ otiSi, then one 
expects [^j^J fiips corresponding to contracting each separately; see Remark [ij 

To figure out the extremal rays contracted by W, recall the divisorial contraction T : Mg — > 
M3 which contracts the extremal ray R generated by elliptic tails. The small contraction 
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— ^ps — cs — ps 
W : Mg — > Mg is induced by K^^ps + 7/10 6^^ and the ample cone of Mg may be analyzed 

in terms of the ample cone of Mg via T. We have 

the hyperplane spanned by a facet of the nef cone of Mg. J*[Kj^vs + 7/10 5^*] contracts 
Ai and the following one dimensional strata |Fab99t IGKM02] . Let Xq be a 4-pointed stable 
curve of genus zero with one point moving and the other three fixed. 

• Attach two fixed 2-pointed curves of genus 1 and g — 3, respectively, to Xq. The 
extremal contraction of this ray has the locus To of elliptic bridges as the exceptional 
locus: 

To={Ci Up,q C2lg(Ci) = 1,g(C2) = g-2}; 

• Attach two 1-pointed curves of genus i and g — 1 — i (with i > 1 and g — 1 — i- > 1 ) 
respectively, and a 2-pointed curve of genus to Xq. This extremal contraction has 
Ti as the exceptional locus: 

T^ = {Ci Up Cz Uq C3 I g(Ci) = i, g(C2) = 1, gfCj] = g - 1 - i}. 

Since W contracts multiple extremal rays corresponding to various elliptic bridges, Q-factoriality 
may not necessarily be preserved under W; indeed, by Theorem [sj Mg^ is not Q- factorial for 

g>7. 

We will deduce the failure of Q-factoriality by applying the theorem below |Dre04| . 

Theorem 2. Let Z be a nonsingular variety on which a reductive group G acts, admitting 
a good quotient n \ Z. ^ M. Suppose that there exists a saturated open subset Zq C Z such 
that 

(1) codimz(Z\Zo) > 2; 

(2) 7t|zo : Zo — > 7t(Zo) is a geometric quotient; 

(3) Gz is finite for z G Zq. 

Then M is Q-factorial if and only if for every G-line bundle L on Z and every closed point 
z £ Z with closed orbit G • z, the stabilizer G^ acts trivially on the fiber L^. 

Remark 3. |Dre041 Theorem 8.3] has stronger assumption that the action of G on Zo be 
free so that 7t(Zo) is smooth and Pic(7t(Zo)) = Cl(Zo). Here, we are concerned about the 
Q-factoriality, and Pic[n{Zo])Q = C1(Zo)(Q is valid with the finite stabilizer assumption. 

hs 

Theorem 3. Mg is <Q-factorial if and only if g < 6. 

Proof. In our setting, we have G = GL3g_3(k) acting on Z = Hilbg^2; t^i^ locus of Hilbert 
semistable curves. By deformation theory, Z is smooth. Let Zo = Hilbg_2 C Z be the locus 
of Deligne-Mumford stable curves. Then (1) codimz(Z \ Zo) > 2, (2) n\zg is a geometric 
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quotient and (3) is finite for z E Zq: (1) follows from simple dimension calculation, and 
(2) and (3) follow since a Deligne-Mumford stable curve is Hilbert stable. 

For g > 6, Let z G Hilbg^i /G be the point representing the curve C = Ci U RU Ci, where 

(1) R = Ri U R2 U R3 is the union of rational curves where Ri meets R2 and R2 meets R3 
at monomial Aa-singularities p2 and ps, respectively; 

(2) Ci (resp. C2) is a genus 2 (resp. g — 4) curve meeting Ri (resp. R3) at a node. 
Then z is a maximally degenerate curve corresponding to a closed orbit and Aut(C)° ~ Gra 
acts on the fiber of 62 with nontrivial character ±1 . This follows from considering the Gra- 
action on the first order deformation space as in Section |6.1[ The divisor 62 is cut out by 
the deformation parameter of the node (where Ci meets Ri) which has weight ±1; it follows 
from [AFSlOl Proposition 5.7] that the character of 62 is ±1. 

For g < 7, by an analysis of the maximally degenerate h-semistable curves and their 

— hs 

induced characters, one can show that Mg is Q-factorial. □ 

Remark 4. (Log canonical models arising from generic scalings) 

Instead of studying the "democratic" log minimal models Mg(cx], one can consider a 
generic log canonical model 



for rational numbers < (Xi < 1 . The divisor K + D is F-nef if —9 + 12ao — oci > and 
at + aj + aic + «! — ai+j — ai+k — at+v < 2 for integers i, j , k, I with g = i + j+ k + L Moreover, 
by IGKM021 Prop. 6.1], K + D is nef if < ao for i > 1 . 

Choose D = ^[^0^^ (X-i^i with at < ao for i > 1 such that K + D is ample. Then K + tD 
is ample for 1 > t > 9/(1 2cxo — ai). One can use the character computations in [AFSlOj to 
make predictions on the moduli interpretations of the log canonical models Mg (tD ) arising 
from scaling t from 1 to 0. At t = 9/(12(Xo — ai), one expects cusps to replace elliptic tails 
in Mg(tD). At t = to = 7/(10(Xo), one expects tacnodes to replace non-separating elliptic 
bridges. For each i = 2, . . . , [^y^J , at t = t,, = 7/(12ao — oci— ai+i ) + e (where in the case that 
g = 2k + 1 is odd, we use the convention that = ajc+i so that ti^ = 7/(12ao — 2ak) + e), 
one expects tacnodes to replace elliptic bridges which separate the curve into genus i and 
g — i — 1 components. If t^ / tj for i / j € {0, 2, 3, . . . [^y'-J}, one expects flips 



Mg(D) := Proj V[M,, Ld(K^g + D)J ), 



d>0 



Lg/2J 

where D = oiibi 

1=0 



Mg((t, + e)D) 



Mg((tt-e)D) 





Mg(tiD) 

for i = 0,2, . . . [fly^J with Mg((ti - e)D) Q-factorial. 
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Curve embed- 
ding 


Linearization 


Log canonical 
model 


Stability & 
Singularity 


Hilb 


n-canonical, 
n > 5 


ra > 


Mg(l) ~Mg 


Deligne- 

Mumford; 

Ai 


Chow 


four-canonical 




Mg(9/11) 


pseudo- 
stability; 
Ai,A2 


Hilb 


four-canonical 


ra > 


Mg(9/11 -e) 


pseudo- 
stability; 
Ai,A2 


Chow 


tri-canonical 




Mg (25/32) 


pseudo- 
stability; 
Ai,A2 


Hilb 


tri-canonical 


ra » 


Mg(25/32-e) 


pseudo- 
stability; 
Ai,A2 


Chow 


bi-canonical 




Mg(7/10) 


c-semistability 
Ai ~A3 


Hilb 


bi-canonical 


ra > 


Mg(7/10-e] 


h-semistability 
Ai ~A3 


Hilb 


bi-canonical 


ra = 6 


Mg(2/3) 


Ai ~ A4 


Hilb 


bi-canonical 


ra = 4.5 


Mg (19/29) 


Ai ~ A4, A^ 


Hilb 


bi-canonical 


ra = 2.25 


Mg (17/28) 


Ai ~A5 


Chow 


canonical 






ADE, ribbons, 
etc 



Table 1. Log canonical models as GIT quotients |FS10] 
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